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rH ■ Abstract 

I— I' A new coupling argument is introduced to establish Driver's integration by parts 

^^ ■ formula and shift Harnack inequality. Unlike known coupling methods where two 

^ , marginal processes with different starting points are constructed to move together as 

^^ I soon as possible, for the new-type coupling the two marginal processes start from the 

(<— ^ ■ same point but their difference is aimed to reach a fixed quantity at a given time. 

Tij" , Besides the integration by parts formula, the new coupling method is also efficient to 

ff^ I imply the shift Harnack inequality. Differently from known Harnack inequalities where 

^^ ' the values of a reference function at different points are compared, in the shift Harnack 

I . inequality the reference function, rather than the initial point, is shifted. A number 

H" I of applications of the integration by parts and shift Harnack inequality are presented. 

• 1— I ' The general results are illustrated by some concrete models including the stochastic 

/\ • Hamiltonian system where the associated diffusion process can be highly degenerate, 

C^ , delayed SDEs, and semi-linear SPDEs. 

AMS subject Classification: 60H10, 47G20. 

Keywords: Integration by parts formula, shift Harnack inequality, shift log-Harnack inequal- 
ity, coupling, Malliavin calculus. 



1 Introduction 

In stochastic analysis for diffusion processes, the Bismut formula [6] (also known as Bismut- 
Elworthy-Li formula due to [8]) and the integration by parts formula are two fundamental 
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tools. Let, for instance, X(t) be the (non-explosive) diffusion process generated by an elliptic 
differential operator on a Riemannian manifold M, and let Pt be the associated Markov 
semigroup. For x E M and U G TxM, the Bismut formula is of type 

TT] (1.1) VuPtf{x)=E{f{X^it))M^{t)}, fe^b{M),t>0, 

where X^{t) is the diffusion process starting at point x, M^{t) is a random variable indepen- 
dent of /, and V;7 is the directional derivative along U. When the curvature of the diffusion 
operator is bounded below, this formula is available with M^{t) explicitly given by U and 
the curvature operator. There exist a number of applications of this formula, in particular, 
letting pt{x,y) be the density (or heat kernel) of Pt w.r.t. a nice reference measure /x, we 
have, formally, 

Vu\ogM;y){x) = E{M%t)\X%t) = y). 

From (II. Ij) one may also derive gradient-entropy estimates of Pt and thus, the following 
Harnack inequality introduced in [15] (see [2| [TO]) 

TTs] (1.2) |P,/r(x) < P,|/|%)e^''(*'^'^), t>0,p>l,x,yeMJeB,iM), 

where Cp{t,x,y) is determined by moments of M'{t) and thus, independent of /. This type 
Harnack inequality is a powerful tool in the study of contractivity properties, functional 
inequalities and heat kernel estimates (see e.g. [18] and references within). 

On the other hand, to characterize the derivative oi pt{x,y) in y, which is essentially 
different from that in x when Pt is not symmetric w.r.t. //, we need to establish the following 
integration by parts formula (see [3]): 

TTs] (1.3) PtiVuf)ix) = E{fiX%t))N%t)}, /GCo^(M),t>0,xeM 

for a smooth vector field U and some random variable N^{t). Combining this formula with 
(II. ip . we are able to estimate the commutator VPt — PtV which is important in the study 
of flow properties, see e.g. [9]. Similarly to (II. ip . inequality (II. 3p can be used to derive a 
formula for Vu^ogpt{x, ■){y) and the shift Harnack inequality of type 

174] (1.4) |Pi/r(x)<Pi(|/roexp.[[/])(x)e^''(*'"'^), t > 0,p > l,x,y e MJ e Bb{M), 

where exp^ : TxM — )■ M, x G M, is the exponential map on the Riemannian manifold. 
Differently from usual Harnack inequalities like (II. 2p . in (ll.4p the reference function /, rather 
than the initial point, is shifted. This inequality will lead to different heat kernel estimates 
from known ones implied by (II. 2p . 

Before moving on, let us make a brief comment concerning the study of these two for- 
mulae. The Bismut formula ( 11. ip has been widely studied using both Malliavin calculus 
and coupling argument (cf. [HJ [191 Elj and references within). Although (ll.3p also has 
strong potential of applications, it is however much less known in the literature due to the 
lack of efficient tools. To see that (II. 3p is harder to derive than (II. ip . let us come back to 
[3] where an explicit version of (11.30 is established for the Brownian motion on a compact 
Riemannian manifold. Unlike the Bismut formula which only relies on the Ricci curvature. 



Driver's integration by parts formula involves both the Ricci curvature and its derivatives. 
Therefore, one can imagine that in general (11. 3p is more complicated (and hence harder to 
derive) than (11. ip . 

To establish the integration by parts formula and the corresponding shift Harnack in- 
equality in a general framework, in this paper we propose a new coupling argument. Contrast 
to usual coupling arguments where two marginal processes start from different points and 
meet at some time (called the coupling time), for the new- type coupling the marginal pro- 
cesses start from the same point but their difference reaches a fixed quantity at a given 
time. 

In the next section, we will introduce some general results and applications on integration 
by parts formula and shift Harnack inequality using the new coupling method. The general 
result obtained in Section 2 will be then applied in Section 3 to a class of degenerate diffusion 
processes, in Section 4 to delayed SDEs, and in Section 5 to semi-linear SPDEs. Finally, in 
Section 6 the integration by parts formula is established for SDEs with multiplicative noise 
using Malliavin calculus. 

We remark that the model considered in Section 3 goes back to the stochastic Hamiltonian 
system, for which the Bismut formula and Harnack inequalities have been investigated in 
[TOj [T9| [2Tj by using both coupling and Malliavin calculus. As will be shown in Subsection 
2.1 with a simple example of this model, for the study of integration by parts formula and 
shift Harnack inequalities the Malliavin calculus can be less efficient than the new coupling 
argument. 

2 Some general results 

In §2.1 we first recall the argument of coupling by change of measure introduced in [H [17] 
for Harnack inequality and Bismut formula, then explain how can we modify the coupling in 
order to derive the integration by parts formula and shift Harnack inequality, and introduce 
the Malliavin calculus for the study of integration by parts formula. In the second sub- 
section we present some applications of the integration by parts formula and shift Harnack 
inequalities to estimates of the heat kernel and its derivatives. 

For a measurable space [E,^), let ^b{E) be the class of all bounded measurable func- 
tions on E, and J3§^{E) the set of all non-negative elements in ^i,{E). When ii^ is a topology 
space, we always take =^ to be the Borel a-field, and let Cb{E) (resp. Co{E)) be the set of 
all bounded (compactly supported) continuous functions on E. If moreover E is equipped 
with a differential structure, for any i > 1 let Cl{E) be the set of all elements in Cb{E) with 
bounded continuous derivatives up to order i, and let Cq{E) = Co{E)r\Cl{E). Finally, a con- 
traction linear operator P on j3§b{E) is called a Markov operator, if it is positivity-preserving 
with PI = 1. 

2.1 Integration by parts formula and shift Harnack inequality 

Definition 2.1. Let /i and u be two probability measures on a measurable space {E,l3§), 
and let X, Y be two ii^- valued random variables w.r.t. a probability space {fl, ^, P). 



(i) If the distribution of X is /.i, while under another probabihty measure Q on (fi, ^) 
the distribution of Y is u, we call (X, Y) a coupling by change of measure for fi and u 
with changed probability Q. 

(ii) If fi and u are distributions of two stochastic processes with path space E, a coupling 
by change of measure for fi and u is also called a coupling by change of measure for 
these processes. In this case X and Y are called the marginal processes of the coupling. 

Now, for fixed T > 0, consider the path space E^ := E^^''^^ for some T > equipped 
with the product cr-field ^^ := ^[°'^1. Let {P''{A) : x e E,A e SS^} be a transition 
probability such that P'^({7 G E^ : 7(0) = x}) = 1, x G E. For any t G [0,r], let 
Pt{x, ■) = P^{{'-f{t) G ■}) be the marginal distribution of P^ at time t. Then 



i't/(x):= / fiy)Ptix,dy), fe^t{E),xeE 

JE 

gives rise to a family Markov operators (Pf)fg[o,T] on ^b{E) with Pq = -^• 

In order to establish the Harnack inequality, for any two different points x, y G P one 
constructs a coupling by change of measure {X, Y) for P^ and P^ with changed probability 
Q = PP such that X(T) = F(T). Then 

iPT/(y)r = iEQ/(F(T))r = iE{p/(x(T))}r 

< (E|/r(X(T)))(EPi^)^-' = (Pr|/r(x))(EP^r\ 

This implies a Harnack inequality of type ( II. 2p . 

To establish the Bismut formula, let e.g. P be a Banach space, and x,e G E. One 
constructs a family of couplings by change of measure (X^, X) for p^+^^ and P^ with changed 
probability Q^ := P^P such that X%T) = X(T), e G [0, 1]. Then, if X^(r) := £Re\e=o exists 
in L^(P), for any / G ^b{E) we obtain 



d 



de 



d 



VePrfix) = —E{RJ{X'{T))} = —E{RJ{X{T))} = E{/(X(T))iV^(T)} 



£=0 



£=0 de 

Therefore, the Bismut formula (11. ip is derived. 

On the other hand, for the integration by parts formula and shift Harnack inequality we 
need to construct couplings with marginal processes starting from the same point but their 
"difference" equals to a fixed value at time T. For simplicity, below we only consider E 
being a Banach space. To extend the result to non-linear spaces like Riemannian manifolds, 
one would need to make proper modifications using the geometric structure in place of the 
linear structure. 

T2. 1 Theorem 2.1. Let E be a Banach space and x,e ^ E and T > be fixed. 

(1) For any coupling by change of measure (X, Y) for P^ and P^ with changed probability 
Q = R¥ such that Y{T) = X(T) + e, there holds the shift Harnack inequality 

|PT/(x)r < Pr{|/r(e + ■)}(^)(EP^)'"\ / G =^,(P), 
and the shift log-Harnack inequality 

PTlog/(x)<logPT{/(e + -)}(x) + E(PlogP), /G^,(P),/>0. 



(2) Let {X,X^),e G [0, 1], be a family of couplings by change of measure for P^ and P^ 
with changed probability Q^ = -R^P such that 

X%T)=X{T)+ee, £6(0,1]. 

If Ro = l and N{T) := -^R^^^q exists in L\F), then 

(2.1) PT{Vef){x) = E{/(X(T))iV(T)}, /, Ve/ G ME). 



IIT 



Proof. The proof is similar to that we introduced above for the Harnack inequahty and 
Bismut formula. 

(1) Note that Prfix) = E{Rf{Y{T))} = E{Rf{X{T) + e)}. We have 

\PTf{xW < (E|/r(X(T) + e)) {ERl^^y-' = PAlf^ie + ■)}(x) (Ei?^)^-\ 

Similarly, for positive /, 

Pt log/(x) = E{R\ogf{X{T) + e)} 
< \ogEf{X{T) + e)+E{R\ogR) = log Prif {e + ■)}{x) +E{R\ogR). 

(2) Noting that Prfix) = E{RJ{X'{T))} = E{RJ{X{T) + ee)}, we obtain 

= ^E{RJ{X{T) + ee)} = Pt{VJ){x) -E{f{X{T))N{T)}, 

provided Rq = I and N{T) := -£r,\,=o exists in L\F). D 

From Theorem 12.11 and it's proof we see that the machinery of the new coupling argument 
is very clear. So, in applications the key point of the study lies in the construction of new-type 
couplings. 

Next, we explain how can one establish the integration by parts formula using Malliavin 
calculus. Let e.g. W := {W{t))t>o be the cylindrical Brownian motion on an Hilbert space 
{H, (-, ■), I ■ I) w.r.t. a probability space {fl,^,F) with natural filtration {,^t}t>o- Let 

H':=!.heC{[0,T];H): \\h\\%^ := f \h'{s)\^ds < oo\ 

be the Cameron-Martin space. For a measurable functional of W, denoted by F[W), such 
that EF{W)^ < oo and 

n..,, . ^n...._u^FiW + eh)-FiW) 



H^3h^ DhF{W) := lim 



£4,0 e 



gives rise to a bounded linear operator. Then we write F{W) G ^{D) and call DF{W) the 
Malliavin gradient of F{W). It is well known that {D,^{D)) is a densely defined closed 
operator on L^(f2, ^^j^; P). Let {D*, S){D*)) be its adjoint operator, which is also called the 
divergence operator. 



ma] Theorem 2.2. Let H,W,D and D* be introduced above. Let e E H and X E S!{D). If 
there exists h E S){D*) such that D^X = e, then 

E(VJ)(X) = E{f{X)D*h}, f E Cl{H). 

Proof. Since D^X = e, we have 

E(VJ)(X) = E{VD,xf){X) = E{DJ{X)} = E{f{X)D*h}. 

n 



FinaUy, as the integration by parts formula (12. ip imphes the derivative-entropy inequahty 

Prf, d>0, 



\Pt{VJ)\ < 6{PT{f log f) - (Pt/) logPr/} +5 log E|exp 

and the L^-derivative inequality 

\PT{VJ)\'<{EN{Tf)PTf, 
according to the following result it also implies shift Harnack inequalities. 

PIS Proposition 2.3. Let P be a Markov operator on ^i,{E) for some Banach space E. Let 
eEE. 

(1) Lei e G ^,(5e G (0,1) an(i/3e G C((5e,cx)) X E;[0,oo)). Then 

Wl^ (2.2) |P(Ve/)|<<5{P(/log/)-(P/)logP/} + /3e(5,-)^/, 5>5e 

holds for any positive f E Cl{E) if and only if 



W12bb 



(2.3) (P/)^<(P{nre + -)})exp 



pr 



-de 



p —\ 



L2G 



SHT 



7q 1 + (p — 1)s Vr + r(p— 1)s' 
holds for any positive f E J^b{E),r E (0, j-) and p > ^_^^g . 
(2) Let C > be a constant. Then 

(2.4) |P(Ve/)P<CPf, fECliE),f>0 

is equivalent to 

Pf < P{f{ae + ■)} + \a\^CPT\ aERjE ^^(E). 



sre Ids 



(2.5) 



Proof. The proof of (1) is similar to that of [ini Proposition 4.1], while (2) is comparable to 
[T6l Proposition 1.3]. 



(1) Let f3{s) = 1 + (p— l)s, s G [0, 1]. By the monotone class theorem, it suffices to prove 
for / e Cl{E). Since f^ > 5^ ior p > y^, it follows from (Q that 



T-log(P{/ 



I3{s), 



ds 



sre 



■)}(^)) 



«^ 



> 



pip - l)[P{(/^(^) log/^(^))(gre + ■)} - (P{/^W(gre + ■)}) logP{/^W(5re + •)}] 

/3(s)2p{//3W(sre + -)} 
prP{VJ^W(gre + -)} 
/3(s)P{/^(^)(sre + -)} 

''^:/3ef^7^, x + sre), sG [0,1]. 



X 



Taking integral over [0, 1] w.r.t. ds we prove f l2.3p . 

Next, let z,e E E he fixed and assume that P(Vef){z) > (otherwise, simply use — e to 
replace e). Then (12. 3p with p = 1 + d^r implies that 



5{{Pf) \ogPf]{z) + \P{VJ)\{z) = hmsup 

r->0 

<hm_supi{(P/-)(.)exp[/^(i±i^ 
= 5PU\ogf){z) + P,{5)Pf{z). 



{P{f{re + .)}f+'^{z)-Pf{z) 



/3e 



5 



1 + 5rs 



, 7(r) jdr 



i^/(^: 



Therefore, (12. 2p holds. 

(2) Let r > 0. For non-negative / G Cl{E), (12^ implies that 



-P 



ds 11 + sr/ 
= -P| •^ 

< -rP 



^ ^a(l-s)e + -)} 

a(l - s)e + ■)} - «^{Ve(Y^^) («(1 - 5)e + ■)} 

a(l-s)e + -)} 



1 + srf 
P 



1 + srf 



[ail — s)e 



aWCP 



f srf 

;i + sr/)2' 



< 



a'C 



4r 



Noting that 



we obtain 



/ 



l + rf 



f 



rP 



l + rf 



>f-rp 



Pf^P{f{ae + -)} + rPp + 



4r ' 



r > 0. 



Minimizing the right hand side in r > 0, we prove (12.51) . 

On the other hand, let x E E. Without loss of generality we assume that P(Ve/)(a;) < 0, 
otherwise it suffices to replace e by — e. Then (12. 5p implies that 



a\.G 



Therefore, ([22]) holds. D 

To conclude this section, we would like to compare the new coupling argument with 
known coupling arguments and the Malliavin calculus, from which we see that the study of 
the integration by parts formula and shift Harnack inequality is in general harder than that 
of the Bismut formula and Harnack inequality. 

Firstly, when a strong Markov process is concerned, for a usual coupling {X{t), Y{t)) one 
may ask the two marginal processes move together after the coupling time, so that to ensure 
X{T) = Y{T) one only have to confirm that the coupling time is not larger than the given 
time T. But for the new coupling argument we have to prove that at time T the difference 
of the marginal processes equals to a fixed quantity, which can not be ensured even if the 
difference already reached this quantity at a (random) time before T. From this we see that 
construction of a new-type coupling is in general harder than that of a usual coupling. 

Secondly, as is well known that the Malliavin calculus is a very efficient tool to establish 
Bismut type formulae. To see the difficulty for deriving the integration by parts formula 
using Malliavin calculus, we look at a simple example of the model considered in Section 3, 
i.e. {X{t),Y{t)) is the solution to the following degenerate stochastic equation on M^: 

l^ (2.6) Ux(t) = Ym, 

' — ' ^ ^ \dY{t) = dW{t) + Z{X{t),Y{t))dt, 

where W{t) is the one- dimensional Brownian motion and Z G C^(M^). For this model the 
Bismut formula and Harnack inequalities can be easily derived from both coupling method 
and Malliavin calculus (see [lOl [191 [2I])- We now explain how can one establish the integra- 
tion by parts formula using Malliavin calculus. For fixed T > and e.g. e = (0, 1), to derive 
the integration by parts formula for the derivative along e using Theorem 12.21 one needs to 
find h e 9{D*) such that 

Dh] (2.7) Dh{X{T),Y{T))=e. 

To search for such an element /i, we note that (12. 6 p implies 

d(Dt,X{t), DhY{t)) = (0, h\t))dt + G{t) (^'y[^^]) dt, Dy,X{Q) = Z},F(0) = 0, 

where 

^^^) ■= (z'(-,F(t))(X(t)) Z\X{t),.){Yit))) ■ 
Then, (12. 7|) is equivalent to 

It is, however, very hard to solve h from this equation for general Z G Cl{M?). On the other 
hand, we will see in Section 3 that the coupling argument we proposed above is much more 
convenient to derive the integration parts formula for this example. 



2.2 Applications 

We first consider E = M'^ for some d > 1, and to estimate tfie density w.r.t. tlie Lebesgue 
measure for distributions and Markov operators using integration by parts formulae and sliift 
Harnack inequalities. 

T4. 1 Theorem 2.4. Let X be a random variable on M.'^ such that for some N G L^{Q — > M.'^; P) 
[4T] (2.8) E(V/)(X) = E{/(X)iV}, feCliR''). 

(1) The distribution Fx of X has a density p w.r.t. the Lebesgue measure, which satisfies 

(2.9) Vlogp(x) = -E(X|X = x), Fx-a.s. 

Consequently, for any e G M'^ and any convex positive function H , 

{H{\V,\ogp\)p]{x)dx <¥.H{\{e,N)\). 



DDO 



nmd.^d)^ 



(2) For any U e Cl[ 

n^uf){X) = E{/(X)((f/(X),iV) - (div?7)(X))}, / G Ci(M'^) 

Proof. (1) We first observe that if P^ has density p, then for any / G Co(M'^), 

{p(x)V/(x)}dx = E(V/)(X) 

E{/(X)E(iV|X)}= / {/(x)E(iV|X = x)}Px(dx). 



This implies (12. 9p . To prove the existence of p, let p„ be the distribution density function of 
Xn := X + -, 77, > 1, where C, is the standard Gaussian random variable on M*^ independent 
of X and X? It follows form ([2SD that 

E(V/)(X„) = E{V/(C/n + ■)}{X) = E{/(X„)X}. 

Then (12. 9p holds for p^ and X„ in place of p and X respectively. Since |X| G -^^(P), this 
implies that the sequence {y^}n>i is bounded in W'^'^iW^] dx). Then, up to a subsequence, 
y^ — )■ y^ in Lf^J^dx) for some non- negative function p. On the other hand, we have 
p„(a;)dx — > Px(dx) weakly. Therefore, Px(dx) = p(x)dx. 

(2) As for the second assertion, noting that for U = J2i=i ^A '^^^ has 

d 

Vc// = 5^9,(t/,/)-/div[/, 



it follows from fl2.8D that 



E{Vuf) {X) = J2 n9i{U,f) {X) } - EifdivU} (X) 



d 



J2mU^f){X)N,} -E{fdwU} 

i=l 

E{/(X)((t/(X),iV)-(divf/)(X))}. 



D 



Next, we consider applications of a general version of the shift Harnack. Let P{x, dy) be 
a transition probability on a Banach space E. Let 



Pfix)= f fiy)Pix,dy), fe 



UM.'') 



be the associated Markov operator. Let $ : [0, oo) — > [0, oo) be a strictly increasing and 
convex continuous function. Consider the shift Harnack inequality 

ra] (2.10) <l>(P/(x)) <P{$o/(e + -)}(a;)e^*(^''^), / e ^+(E) 

for some x,e & E and constant C$(a;, e) > 0. Obviously, if $(r) = r^ for some p > 1 then 
this inequality reduces to the shift Harnack inequality with power p, while when $(r) = e'' 
it becomes the log shift Harnack inequality. 

T4.2 Theorem 2.5. Let P be given above and satisfy f l2.10p for all x,e E E := M.'^ and some 
non-negative measurable function C$ on Mf^ x Mf^. Then 

Iao] (2.11) sup <^{Pf){x)<j. _^ , xeR'^. 

(1) //$(0) = 0, i/ien P has a transition density g{x,y) w.r.t. the Lebesgue measure such 
that 

(2.12) l^ ,(., ,)*-•(.(., .))d. < *- (j—kl^) ■ 



AAl 



(2) If^{r) = r^ for some p > 1, then 

(2.13) / Qix,y)^^dy< 



(/i8de-^*(^''^)de)p 



10 



Proof. Let / G ^+{R'^) such that J^, <l>(/)(x)dx < 1. By JHAOh we have 

$(P/)(x)e-^*(^''=) <P{$o/(e + -)}(a;)= / ^of{y + e)P{x,dy). 

Integrating both sides w.r.t. de and noting that Jj^^ $ o /(y + e)de = Jj^^ $ o /(e)de < 1, we 
obtain 

$(P/)(x) /" e-'^*(^''"Me < 1. 

jRd. 

This imphes (EH]). When $(0) = 0, (121T11 imphes that 

[M^ (2.14) sup P/(a;) < $-^ ( r ,-li.,e)ae ) < ^ 

since by the strictly increasing and convex properties we have $(r) f oo and r f oo. Now, 
for any Lebesgue-null set A, taking /„ = uIa we obtain from $(0) = that 



$ o /„(x)dx = < 1. 
Therefore, applying (12.141) to / = /„ we obtain 



P(x,A) = Pl.W<i*-.(j_l^-^) 



which goes to zero as n — ?■ oo. Thus, P(x, ■) is absolutely continuous w.r.t. the Lebesgue 
measure, so that the density function g{x, y) exists, and (12.121) follows from (12. lip by taking 
f{y) = (^-\g{x,y)). 

Finally, let <l>(r) = r^ for some p > 1. For fixed x, let 

fn{y) = — r, n>l. 

{lRd{nAg{x,y)}p-^dy)'' 

It is easy to see that J^^ fn{y)^y — 1- Then it follows from (12. lip with $(r) = r^ that 

1 



inAg{x,y)}p-^dy<{Pfn{x))^-'<—— _^ 

'' (/jjde-'^*(^'^)de)p-i 

Then fl233ll follows by letting n -^ oo. D 

Finally, we consider applications of the shift Harnack inequality to distribution properties 
of the underlying transition probability. 

T4.3 Theorem 2.6. Let P he given above for some Banach space E, and let (I2.10p hold for 
some x,e & E, finite constant C$(x,e) and some strictly increasing and convex continuous 
function $. 

11 



(1) P{x, ■) is absolutely continuous w.r.t. P{x, ■ — e). 

(2) //$(r) = r\l/(r) for some strictly increasing positive continuous function "^ on (0, oo). 

P{x,dy) 
P{x,dy-e) 



Then the density g{x, e; y) := „. ^^' _ ^ satisfies 



I ^{q{x, e; y))P{x, dy - e) < ^-^ (e^*(^'^)) . 

JE 



Proof. For P(x, ■ - e)-null set A, let / = 1^. Then fl2A0D implies that $(P(x,A)) < 0, 
hence P(x, A) = since $(r) > for r > 0. Therefore, P{x, ■) is absolutely continuous w.r.t. 
P(x, ■ — e). Next, let <l>(r) = r\l/(r). Applying (12.101) for f{y) = \l/(n A ^(x, e; ?/)) and noting 
that 



Pf{x)= / {^(nA^(x,e;i/))}P(x,dy) > / 't>{n A g{x,e;y))P{x,dy - e), 

J E JE 

we obtain 

/ ^{n A ^(x, e; y))P{x, dy - e) < ^"^ (e^*(^'<^)) . 

JE 

Then the proof is completed by letting n ^ oo. D 

3 Stochastic Hamiltonian system 

Consider the following degenerate stochastic differential equation on R"*"'"'^ = W^ x W^{m > 
0,d> 1): 

idXit) = {AXit) + BYit)}dt, 
^-^ ^'' \dY{t) = Z{t,X{t),Y{t))dt + a{t)dW{t), 

where A and B are two matrices of order mxm and mxd respectively, Z : [0, oo) x M™"'"'^ — >■ 
M"^ is measurable with Z{t, ■) G C^(M™"'"'^) for t > 0, {(T(t)}f>o are invertible d x (i-matrices 
measurable in t such that the operator norm ||cr(-)~^|| is locally bounded, and W{t) is the 
d- dimensional Brownian motion. 

When m > 1 this equation is degenerate, and when ?n = we set R'" = {0}, so that 
the first equation disappears and thus, the equation reduces to a non-degenerate equation 
on M'^. To ensure the existence of the transition density (or heat kernel) of the associated 
semigroup Pt w.r.t. the Lebesgue measure on M'"+'^, we make use of the following Kalman 
rank condition (see [TT]) which implies that the associated diffusion is subelliptic: 

(H) There exists < fc < m - 1 such that Rank[P, AB,--- , A'^B] = m. 

When m = this condition is trivial and for m = 1 it means that Rank(P) = 1, i.e. B ^ 0. 
For any m > 1 and d > 1, there exist a plenty of examples for matrices A and B such 
that (H) holds (see [H]). Therefore, we allow that m is much larger than d, so that the 
associated diffusion process is highly degenerate (see Example 3.1 below). 
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HS 



It is easy to see that ii m = d, a{t) = Idxd, and 

Z{x,y) = -{VV{x) + A*y + F{x,y){Ax + By)} 
for some smooth functions V and F, then (13. ip reduces to the Hamiltonian system 

■ ' [dYt = -{VH{;Yt){Xt) + F{Xt,Yt)VH{Xt,-)iYt)}dt + dW{t) 

with Hamiltonian function 

d 



H{x, y) = V{x) + {Ax + By,y)--J2 Buy 



2 



j=l 



see e.g. [13]. If, in particular, A = 0,B = Idxd and F = c for some constant c, the 
corresponding Fokker-Planck equation is known as the "kinetic Fokker-Planck equation" 
in PDE (see [H]), and the stochastic equation is called "stochastic damping Hamiltonian 
system" (see [20]). 

Let the solution to (13. ip be non-explosive, and let 



Pi/ = E/(X(t),F(t)), t>o,fe 



'61 



nm+d\ 



T3.1 



To state our main results, let us fix T > 0. For non-negative G C([0,T]) with > in 
(0,T), define 

Q^= r0(t)e(^-*)^EE*e(^-*)^*dt. 
Jo 

Then Q^ is invertible (cf. [12] )• For any z G M™"'''^ and r > 0, let B{z] r) be the ball centered 
at z with radius r. 

Theorem 3.1. Assume (H) and i/iai i/ie solution to (13. ip zs non- explosive such that 



W] (3.3) sup e| sup |VZ(t, ■)|2| < oo, r>0. 

t6[0,T] •- B(X(t),Yit)\r) ^ 

Letcj),^ G Ci([0,T]) such that (j){0) = (f){T) = O,0> m (0,r), and 



PS 



(3.4) 7/^(T) = 1, 7/;(0) = 0, / ilj{t)e^^-'^^Bdt = 0. 



T 



Moreover, for e = (ei, 62) G M™+'^, /ei 

/i(t) = 0(t)5*e(^-*)^*g^iei + ^(t)e2 G M^ 

e(t) = ( /" e(*-")^5/i(s)ds, /i(t) J G M™+^ t G [0,T]. 
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(1) For any f G Cl{R"''+'^), there holds 

PT(Ve/) =E|/(X(T),y(T))^ (^a{tr'{h'{t)-Veit)Z{t,-){X{t),Y{t))}, dW{t) 

(2) Let (X(0),y(0)) = {x,y) and 



R = exp 



1 '•^ 



{aitr%it),dW{t))-- / \a{t)-%it)\Mt 



2 Jo 



w/iere ei(t) = h'{t) + Z(t, X(t), F(t)) - Z{t, X\t), Y\t)) and {X\t), Y\t)) solves the 
equation 

'dX\t) = {AX\t) + BY\t)}dt, X\0) = X, 
dY\t) = a{t)dW{t) + {Z{t,X{t), Y{t)) + h'{t)}dt, Y\0) = y. 

Then 

\PTfix,y)f < Prilfl^ie + ■)}(x,y)(Ei?^)^~\ p > 1,/ G ^tiE), 
PTlogf{x,y) < \ogPT{f{e + -)}{x,y) + E{R\ogR), f G ^b{E)J> 0. 

Proof. We only prove (1), since (2) follows from Theorem 12.11 with the coupling constructed 
below for e = 1. Let (X°(t), F°(t)) = {X{t),Y{t)) solve (O) with initial data {x,y), and 
for e G (0, 1] let {X''{t),Y'{t)) solve the equation 

(dX%t) = {AX%t) + BY%t)}dt, X%0)=x, 
' ^'' \dY%t) = a{t)dW{t) + {Z{t,X{t),Y{t))+eh'{t)}dt, Y'{0)=y. 

Then it is easy to see that 

'Y%t) =Y{t)+eh{t) 



SOL 



^^■^^ "^ X'{t) = X{t) + e Jl e^'-'^^Bh{s)ds. 

Combining this with 0(0) = 0(T) = and (13. 4p . we see that h{T) = 62 and 

f e^'r-^)^Bh{t)dt = r0(t)e(^-*)^55*e(^-*)^*g^ieidt+ r^(t)e(^-*)^5e2dt = d. 

JQ Jo Jo 

Therefore, 



C^ (3.7) (X^(T),y^(T)) = (X(T),F(T))+£e, £G[0,1]. 



ccc 



Next, to see that ((X(t), F(t)), (X^(t), F^(t))) is a coupling by change of measure for the 
solution to (13. ip . reformulate (13. 5p as 

fdX-(t) = {AX^(t) + BY%t)}dt, X%0) = X, 

\dY%t) = a{t)dW'{t) + Z{t,X'{t),Y%t))dt, Y'(0)=y, 
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where 



W%t):=W{t)+ [ a{sy'{eh'{s) + Z{s,X{s),Y{s)) - Z{s,X'{s),Y'{s))}ds, t E [0,T]. 
Jo 



XI 



Let 

(3.9) 

and 



Us) = eh'is) + Z{s, X{s), Y{s)) - Z{s, X%s), Y%s)) 



Re = exp 



[aisr%is),dWis)) --J^ \a{s)-%{s)\'ds 



By Lemma [3^ below and the Girsanov theorem, ly^(t) is a d-dimensional Brownian motion 
under the probabihty measure Q^ := ii^P. Therefore, ((X(t), F(t)), {X%t),Y%t))) is a 
couphng by change of measure with changed probabihty Q^. Moreover, combining (13.61) 
with the definition of R^, we see from (13.31) that 



dR, 



de 



T 



a;\h\s) - Ve(.)^(s, ■){X{s), Y{s))],dW{s] 



e=0 JO 

holds in L}{¥). Then the proof is completed by Theorem 12.1( 2). 



D 



|ll| Lemma 3.2. Let the solution to (13. ip he non-explosive such that (13. 3p holds, and let ^^ he 
in (13. 9p . Then for any e e [0, 1] the process 



Re{t) = exp 



[a{sr%{s),dW{s))-l I \a{sr%{s)\Ms 



te[o,T] 



IS a uni 



iformly integrable martingale with sup^^jQ-p] E|i?£(t) logi?£(t)} < oo. 



Proof. Let r„ = inf{t > : \X{t)\ + 1^(^)1 >n},n> 1. Then r,i t oo as ra t oo. It suffices to 
show that 



WWL 



(3.10) 



sup E{Re{t A r„) log i?e(t ATn)} < OO. 
fg[0,T],n>l 



By (13. 6p . there exists r > such that 
QQQ] (3.11) iX'{t),Y'{t))eB{X{t),Y{t);r), t G [0,T],£ G [0, 1]. 



Let Qe^n = Re(T A r„)P. By the Girsanov theorem, {W^^(i)}tg[o,TAr„] is the d- dimensional 
Brownian motion under the changed probability Qe,n- Then, due to (13. lip . 

1 pTATn 

sup E{i?,(t A r„) log i?,(t A r„)} = -Eq_ / |a(s)-^e.(s)rds 

G[0,T1 ^ Jo 



t6[0,T] 


^ Jo 




pTAt^ 


< C + CEq,,„ 


/ sup |VZ(t,-)pdt 




Jo B{X^{t),YHty,r) 
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holds for some constant C > independent of n. Since the law of {X'^{- A r„),y^(- A r„)) 
under Q^^^ coincides with that of (X(- A r„),y(- A r„)) under P, combining this with (13. 3p 
we obtain 



SnV ^{Re{t^Tn)\ogRe{t^Tn)} <C + C I E SUp | VZ(t, ■) ^dt < OO. 

tGfO,Tl Jo B(X(t),ym;r) 



r-T 

tG[0,T] Jo B{X{t),y{t);r) 

Therefore, flSrTOj) holds. D 



Remark 3.1 (a) As shown in [TOl Lemma 2.4], condition (13. 3p is implied by the Lya- 
punov condition (A) therein, for which some concrete examples have been presented in |10] . 
Moreover, as shown in [TUl §3] (see also Theorem 4.1 in pTO]) that under reasonable grown 
conditions of V2'(t, ■) one obtains from Theorem 13. If 1) 

Pt\Vf\ < 6{Ptif\ogf) - iPtf)\ogPtf} + ^^Ptf, t>OJe i^+(M'"+'^),(5 > 6o 

for some constant ^q > and some positive functions W{t,-). According to Theorem \'2.2\ 
this inequality implies the shift Harnack inequality. 

(b) For any T2 > Ti. Applying Theorem 13.11 to {X(t),Y(t)) := (Xj-^+t, l^i+t) in place of 
{X{t),Y{t)), we see that the assertions in Theorem 13.11 hold for 

Pn,Tj{x,y) ■.= E{f{XT,,YT,)\{XT,,YTj = {x,y)) 

in place of Pxf with T and replaced by T2 and Ti respectively. 

To derive explicit inequalities from Theorem 13. Ij we consider below a special case where 
||V2'(t, ■)||oo is bounded and A'- = for some natural number I > 1. 

C3.2 Corollary 3.3. Assume (H). // ||VZ(t, ■)||oo and ||o"(t)~^|| are bounded in t > 0, and A'- = 
for some I > 1. Then there exists a constant C > such that for any positive f G 
^fe(M'"+'^),T > ande= (61,62) G M™+'^.- 



(l) {PTfy<PT{fne + -)}exp ^P H^2p , |6ip 



p-1 Vl AT (1 AT)4*^+3 



p> 1; 



(2) Prhgf < \ogPAf{e + .)} + c{^ + ^^ ^t^'^^^^s ); 

(3) For f e CliR-^'), IP.V JP < ClPrf^^ + ^^^1^^^^ 

(4) For strictly positive f E Ci(M™+'^), 
|PTVJ|(x,y)<^{PH/log/)-(Pr/)logPT/} + y(^+ ^j!^'^1.^3 )PT/, S>0. 
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Proof. According to Remark 3.1(b), Pt = Pt-iPt-i,t, and the Jensen inequality, we only 
need to prove for T e (0,1]. Let 0(t) = ^-^^. Then 0(0) = 0(T) = and due to [HI 
Theorem 4.2(1)], the rank condition (H) implies that 

(3.12) lig^l < cT-(2fc+i) 

for some constant c > independent of T G (0, 1]. To fix the other reference function ip in 
Theorem 13.11 let {q}i<j</+i G M be such that 



e::iq = o 

j+i+i 
Take 



1 + ES7^Q = 0, 0<j</-1. 



V;(t) = l + ^Q^^, tG[0,T]. 



rT, 



Then V'(O) = 0,^(T) = 1 and /g (T - t)^Xt)dt = for < j < / - 1. Since A^ = 0, we 
conclude that J^ ?/^(t)e^"'"~*^^dt = 0. Therefore, (13. 4p holds. It is easy to see that 

\m\<c, \i''{t)\<cT-\ tG[0,T] 

holds for some constant c > 0. Combining this with (I3.12p . (13.61) and the boundedness of 
||VZ||oo and ||(T~^||, we obtain 

[**] (3.13) |e,(t)| + |/.'(t)|<c(T-2('^+i)|ei|+T->2|), mt)\ < c{T-^''^'^e^\ + {e^D 



for some constant c > 0. From this and Theorem 13. H we derive the desired assertions. D 

Corollary 3.4. In the situation of Corollary \3.3\ Let \\ ■ \\p^q be the operator norm from W 
to L'^ w.r.t. the Lehesgue measure on M"*+'^. Then there exists a constant C > such that 

m-\-d 
, , 1 / X) \ ~2^ d+(4fc + 3)m 

^ (3.14) \\p^\\^^^<c-v(^-^) " (lAT) ^^, p>l,T>0. 

Consequently, the transition density pT{{x,y),{x',y')) of Pt w.r.t. the Lehesgue measure on 
M™+'^ satisfies 



PTi{x,y),{x',y'))p~^dx'dy' 

HHH (3.15) m + d 
1 / W \ 2(n-U d+(4fc + 3)m 

<C~'(-Zt) (lAT) ^i?^^, T>0,(x,y)GM'"+^p> 1. 

Proof By Corollary [33](1), fl3:TD follows from fl2ll]) for Pt = P, $(r) = r^ and 
C<^((x, y), (ei, 62)) = - — - — — ^ + 



p-lVlAT (lAr)4fc+3. 
Moreover, (KT5\i follows from f l213|) . D 
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A.l' 



Example 3.1. A simple example for Theorem 13.31 to hold is that a{t) = a and Z{t, ■) = Z 
are independent of t with HVZHoo < C)0, A = 0, and Rank(i?) = m. In this case we have 
d > m, i.e. the dimension of the generate part is controlled by that of the non-degenerate 
part. In general, our results allow m to be much larger than d. For instance, let m = Id for 
some I > 2 and 

/ \ 



A 



/o 




Idxd 




■ 

Idxd ■ 


■ 

■ 


\ 











• 
• 


■ 

■ 


hxd 
/ 



B 



{ld)x{ld) 





\Idxd/ 



(ld)xc 



Then A^ = and (H) holds for A; = m — 1. Therefore, assertions in Corollary 13.31 hold for 
k = l-l. 

4 Functional stochastic differential equations 

The purpose of this section is to establish Driver's integration by parts formula and shift 
Harnack inequality for delayed stochastic differential equations. In this case the associated 
segment processes are functional-valued, and thus, infinite- dimensional. As continuation 
to Section 3, it is natural for us to study the generalized stochastic Hamiltonian system 
with delay as in [3], where the Bismut formula and Harnack inequalities are derived using 
coupling. However, for this model it seems very hard to construct the required new-type 
couplings. So, we only consider here the non-degenerate setting. 

Let r > be a fixed number, let ^ = C([— r, 0]; M'^) be equipped with uniform norm 
II ■ II oo- For simplicity, we will use V to denote the gradient operator both on M'^ and ^. For 
instance, for a differentiable function F on ^ and C, & ^, VF{C,) is a linear operator from ^ 
to R with 



^37]^ V,F(0 



lim 



Moreover, let || ■ || be the operator norm for linear operators. Finally, for a function h E 
C{[-T, oo); M'^) and t > 0, let /ij G ^ be such that /ij(^) = h{t + 9),e e [-r, 0]. 
Consider the following stochastic differential equations on 



pd. 



(4.1) 



dX{t) = b{t, Xt)dt + a{t)dW{t), t > 0, 



where W{t) is the Brownian motion on M"^, b : [0, oo) x ^ — )• M*^ is measurable such that 
II V6(t, ■)||oo is locally bounded in t, and a : [0, oo) — ;■ M'' ® M'^ is measurable with ||cr(t)~-^|| 
locally bounded. We remark that the local boundedness assumption of ||V6(t, ■)||oo is made 
only for simplicity and can be weakened by some growth conditions as in [1]. 

Now, for any ^ G ^, let X^{t) be the solution to ( CT]) for Xq = ^, and let X^ be the 
associated segment process. Let 



PiF(0 = EF(X«), t>o,^e^,Fe ^fe(^). 



We aim to establish the integration by parts formula and shift Harnack inequality for Pt- 
It turns out that we are only able to make derivatives or shifts along directions in the 
Cameron-Martin space 

^:=|/iG^: \\h\\%.:= f \h' {t)\Mt < oo\ . 



T3 . 1 ' I Theorem 4.1. Let T > r and r) e J^ he fixed. For any G e^b([0,T - r]) such that 
j^~^ <P{t)dt = 1, let 

p.^^^ f0W^(-r), z/tG[0,T-r], 
\r/'(t-T), ifte{T-T,T]. 

Let ||a(t)-i < Ji(r), ||V6(t,-)lloo < <T) forte [0,T]. 

(1) ForanyFeCli^), 

Pt{V,F)=e(f{Xt)J /^a{tr\T{t) -VeMt,-){X,)),dW{t)^ 
holds for 

/•tVO 

e(t) = / r(s)ds, te [-T,T]. 
Jo 

Consequently, for any 6 > and positive F G C^(^), 

\PT{Vr^F)\ < 6 {Pt{F log F) - (PtF) log PtF} 

+ -^ (^IhlLif + y_^ )PtF. 

(2) For any non-negative F G i^fe(^), 



(3) For any positive F G ^b{^), 



p — I 






PrlogF < log PT{F{r] + ■)} + 2K{T)\l + K{TfT^) (\\r]\\% + 



\vi-r)\' 

T-T 



Proof For fixed ^ G ^, let X{t) solve gl]) for Xq = ^. For any £ G [0, 1], let X^(t) solve 
the equation 

dX'{t) = {6(t, Xt) + er(t)}dt + a{t)dW{t), t > 0, X^ = ^. 

Then it is easy to see that 

THO] (4.2) X," = Xt + eGi, t G [0, T]. 

19 



In particular, X^ = Xt + srj. Next, let 



i?£ = exp 



a{tr^{eT{t) + h{t,Xt)-h{t,Xt)]AW{t)) 



aity^eVit) + h{t,Xt) -h{t,Xt)] 



dt 



By the Girsanov theorem, under the changed probability 



i?eP, the process 



W'{t):=W{t)+ [ a{sy\T{s) + b{s,X,)-bis,XI))ds, t e [0,T] 
Jo 

is a d- dimensional Brownian motion. So, {Xt,X^) is a coupling by change of measure with 
changed probability Qg. Then the desired integration by parts formula follows from Theorem 
Em since Ro = I and due to ( lOjl . 



^- 



e=0 



aitr'{Tit) -WeMt,-)iX,)),dWit) 



holds in L^(P). Taking 0(t) = jr-^, we have 



/ |r(t)|Mt< ||r/|L5^ + 

Jo 



H-r)\ 

T-T 



LLO 



Then 

(4.3) 
So, 



y" |r(t) - V,,6(^, ■){Xt)\'dt < 2(1 + T2k(T)2) (||ry||2,, + 



H-r)\' 

T-T 



log E exp 



1 



a(t)"i{r(t)-Ve,&(^,-)TO},dl^W) 



2K(T) 



2 /"T 



/ |r(t)-Ve,K^,-)TOrdt 



< - log E exp 

^ 2K{Tf{l + T^K{Tf) ( |r/(-r)p 



52 v""'-^ ■ T-r 

Then the second result in (1) follows from the Young inequality 
|^t(V^F)| <5{PT{F\ogF) - {PTF)\ogPTF} 



+ 6 log E exp 



] £ {aitr^m -WeMt,-)iX,)},dW{t)) 



Finally, (2) and (3) can be easily derived by applying Theorem 12. II for the above constructed 
coupling with e = 1, and using (14. 2 p and (14. 3p . D 
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From Theorem 14. II we may easily derive regularization estimates on Pt{C,, ■), the distribu- 
tion of Xf.. For instance, Theorem 14.1( 1) imphes estimates on the derivative of Pt{^, A + ■) 
along 7] G J^ for .^ G ^ and measurable A G ^] and due to Theorem 12.61 Theorem 14.1( 2) 
and (3) imply some integral estimates on the density PTi^^V'-il) ■= p fg d - ) ^°^ ^ ^ ^• 
Moreover, since Jif is dense in '^, the shift Harnack inequality in Theorem 14.1( 2) implies 
that Pt{^, ■) has full support on '^ for any T > t and .^ G ^. 

5 Semi-linear stochastic partial differential equations 

The purpose of this section is to establish Driver's integration by parts formula and shift 
Harnack inequality for semi-linear stochastic partial differential equations. We note that the 
Bismut formula has been established in [5] for a class of delayed SPDEs, but for technical 
reasons we only consider here the case without delay. 

Let {H, (-, ■), I ■ I) be a real separable Hilbert space, and (W(t))t>o a cylindrical Wiener 
process on H with respect to a complete probability space {Q, ^, P) with the natural fil- 
tration {^t}t>o- Let <^{H) and ^hs{H) be the spaces of all linear bounded operators and 
Hilbert-Schmidt operators on H respectively. Denote by || ■ || and || • \\hs the operator norm 
and the Hilbert-Schmidt norm respectively. 

Consider the following semi-linear SPDE 

ldX(t) = {AX{t) + b{t,X(t))}<it + <T(t)dW(t), 
S (") \x{0) = xeH, 

where 



(Al) [A, ^{A)) is a linear operator on H generating a contractive Co-semigroup (e' 



tA-] 



lt>0 



such that Jg 1 1 e"*^ 1 1 If 5^5 < oo. 



(A2) b : [0, oo) x iJ — )■ if is measurable, and Frechet different iable in the second variable 
such that ||V6(t, ■)||oo := sup^,gj|^ l|Vfe(t, ■){x)\\ is locally bounded in t > 0. 

(A3) a : [0, cxd) — > ^{H) is measurable and locally bounded, and a{t) is invertible such that 
||(T(t)~^|| is locally bounded in t > 0. 

Then the equation (15. ip has a unique a mild solution (see [7]), which is an adapt process 
{X{t))t>o on H such that 

X(t) = e*^x+ f e(*-^)^6(s,X(s))ds+ f e^'-'^'^a{s)dWis), t>0. 
Jo Jo 

Let 

Ptf{X{0)) = E/(X(t)), t > 0,X(0) EHJE <^,{H). 

Finally, for any e G ii, let 

nt 

e(<-^Meds, t > 0. 
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T5.1 



Theorem 5.1. Let T > and e e H be fixed. Let \\a{ty^\\ < K{T), ||V6(t, OIU < n{T) 
forte[0,T]. 

(1) For any f G Cl{H), 

PriVeJ) = e(^/(X(T)) ^ (^a{tr' (e - VeMt, ^(^W)), dl^ W^ 
Consequently, for any 6 > and positive f G Cl{H), 

\PT{VeJ)\<6{PT{f log f)-{PTf)logPTf} + ^^^^{T+T\{T) + ^-^^^)PTf. 

(2) For any non-negative F G j3§b{H), 

{PtFY< (Pr{F(eT + -)r)exp 



T^K{Tf 






p — I 



(3) For any positive F G ^b{H), 



Pt log F < log PriFicT + ■)} + i^(T)>n T + T'k{T) 



T'^KiTf 



TH 



Proof. For fixed xeH, let X(t) solve (gl]) for X(0) = x. For any e G [0, 1], let X^{t) solve 
the equation 

dX"(t) = |AX"(t)6(t, X(t)) + ee\&t + a(t)dl^(t), t > 0, X(0)" = x. 

Then it is easy to see that 

(5.2) X'{t)=X{t)+eet, tG[0,T]. 

In particular, X^{T) = X{T) + ect- Next, let 



Re = exp 



T 



a{t)-'^ee + b{t,X{t))-b{t,X%t))ydW{t)'f 
a{t)-'^ee + b{t, X{t)) - b{t, X'{t))^ 



dt 



By the Girsanov theorem, under the weighted probability Q^ := -RgP, the process 

W%t) := W{t) + I a(s)-^ [ee + b{s, X,) - 6(s, X|)) ds, t G [0, T] 

is a d-dimensional Brownian motion. So, (X(t),X'^(t)) is a coupling by change of measure 
with changed probability Q^. Then the desired integration by parts formula follows from 
Theorem 12.11 since Rq = 1 and due to (15. 2p , 



de 



-R' 



e=0 



j {a{t)-'{e-V,fi{t,-){X{t)))AW{t) 
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holds in L^iJP). This formula implies the second inequality in (1) due to the given upper 
bounds on ||cr(t)~-'^|| and ||V6(t, ■)|| and the fact that 



|Pt(V,F)| - 6 {Pt{F log F) - (P^^F) log P^i^} 
< (51ogEexp 



1 ^ (a(t)-i (e - VeMt, -KXit))) , dW{t) 
1^ \a{tr'(^e-VeMt,-){X{t)) 



PtF 



< - log E exp 

Finally, since \et\ < t\e\, (2) and (3) can be easily derived by applying Theorem 12.11 for the 
above constructed coupling with e = 1. D 
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